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Red Light, Purple Light! 


Abstract 
Considerable research has examined interventions that facilitate school readiness skills in young 
children. One intervention, Red Light, Purple Light Circle Time Games (RLPL; Schmitt, 
McClelland, Tominey, & Acock, 2015; Tominey & McClelland, 2011), includes music and 
movement games that aim to foster self-regulation skills. The present study (N = 157) focused on 
children from families with low-income and compared the RLPL intervention (SR) to a revised 
version of RLPL that included literacy and math content (SR+) and a Business-As-Usual (BAU) 
control group. In both versions of the intervention, teachers were trained to administer the self- 
regulation intervention in preschool classrooms with coaching support. Although not statistically 
significant, children receiving either version of the intervention gained more in self-regulation on 
the Head-Toes-Knees-Shoulders (HTKS) over the preschool year compared to the BAU group (f 
= .09, p = .082, Cohen’s d= .31). Effect sizes were similar to previous studies (Duncan, Schmitt, 
Burke, & McClelland, 2018; Schmitt et al., 2015) and translated to a 21% difference in self- 
regulation over and above the BAU group at post-test. Furthermore, children participating in 
either version of the intervention gained significantly more in math across the school year 
compared to children in the BAU group (f = .14; p = .003, Cohen’s d= .38), which translated to 
a 24% difference in math over and above the BAU group at post-test. Results were somewhat 
stronger for the SR+ version, although effect sizes across intervention conditions were 
comparable. There were no statistically significant differences across groups for literacy skills. 
Results extend previous research and suggest that the RLPL intervention, which includes an 
explicit focus on self-regulation through music and movement games, may improve children’s 


self-regulation and math scores over the preschool year. 
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Red Light, Purple Light! Results of an Intervention to Promote School Readiness for Children 
from Low-Income Backgrounds 
A disproportionate number of children with low self-regulation and academic skills at 

kindergarten entry are from families experiencing socioeconomic disadvantage (Blair & Raver, 
2015; Evans & Rosenbaum, 2008; Wanless, McClelland, Tominey, & Acock, 2011). Given 
existing school readiness gaps, it is critical to design programs that promote the development of 
self-regulation skills for children from diverse backgrounds. In recent years, numerous 
interventions have emerged that include self-regulation as part of more comprehensive programs, 
many that also include academic skills (e.g., PATHS, Tools of the Mind; Diamond, Barnett, 
Thomas, & Munro, 2007; Domitrovich, Cortes, & Greenberg, 2007). Although many of these 
interventions have shown significant effects in improving aspects of children’s self-regulation, 
few have demonstrated substantive effects on self-regulation and early academic skills (Bierman, 
Nix, Greenberg, Blair, & Domitrovich, 2008; Raver et al., 2011), and others demonstrate no 
effects on self-regulation or academic outcomes (Farran, Wilson, & Lipsey, 2013; Morris, 
Mattera, Castells, & Bangser, 2014). Moreover, comprehensive curricula require extensive 
training to implement with fidelity, which may help explain null, small, and moderate effect 
sizes. Although aligned with best practices for early childhood, the comprehensive approach to 
intervention can make it challenging, if not impossible, to determine what part of each program 
is most effective. In order to accommodate early childhood education programs that are likely to 
have limited resources and time to commit to professional development, it is critical to develop 
interventions where the impact of specific components can be tested in order to identify core 
elements that could be integrated with little time and at low-cost into existing comprehensive 


early childhood curricula. 
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The present study evaluated and compared the effectiveness of two versions of a teacher- 
implemented school readiness intervention called Red Light, Purple Light Circle Time Games 
(RLPL; McClelland & Tominey, 2015). One version of the program was a self-regulation only 
version (SR), and the other was a self-regulation plus math and reading version (SR+), which 
was informed by best practices to support reading and math development. Both were designed 
for teachers to administer in preschool classroom settings. Given the targeted nature of the 
intervention and that RLPL requires few resources to implement (e.g., materials found in typical 
early childhood classrooms, half day of professional development), the intervention can feasibly 


be implemented in classrooms to benefit self-regulation and early academic achievement. 


The Development of School Readiness 

Self-regulation. Self-regulation has been conceptualized across disciplines in many 
ways; however, it is commonly recognized as a multidimensional concept that incorporates 
emotion, cognition, and behavior (McClelland, Cameron Ponitz, Messersmith, & Tominey, 
2010). The present study focuses on the aspects of self-regulation most relevant in classroom 
contexts, which are related to three underlying executive function (EF) cognitive processes: 
working memory, attentional or cognitive flexibility, and inhibitory control (Cameron Ponitz, 
McClelland, Matthews, & Morrison, 2009). Working memory refers to the ability to maintain 
and manipulate information (Gathercole, 2008); attentional or cognitive flexibility is the ability 
to sustain focus and adapt to changing goals (Rothbart & Posner, 2005); and inhibitory control 
includes stopping a dominant response in favor of a more appropriate one (Blair, 2003). 
Although each aspect of executive function contributes to academic outcomes, evidence suggests 
that the integration of working memory, attentional or cognitive flexibility, and inhibitory control 


in children’s overt behavior is important for their success in early classroom contexts (Blair & 
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Raver, 2015; McClelland & Cameron, 2012). In this study, we refer to self-regulation to capture 
children’s EF processes in real-world settings. Self-regulation emerges in early childhood and 
during this period, acquisition of these skills involves various environmental and developmental 
processes (Blair & Raver, 2015; McClelland, Geldhof, Cameron, & Wanless, 2015). In addition, 
self-regulation has been shown to be a malleable set of skills that mediate the relation between 
early risk and academic success (Sektnan, McClelland, Acock, & Morrison, 2010). Thus, 
targeting self-regulation prior to formal schooling may be one way to improve children’s school 
readiness. 

Early math skills. Early math consists of skills and concepts that build upon one another 
and include domains such as numeracy (National Mathematics Advisory Panel, 2008, [NMAP]; 
National Research Council, 2009, [NRC]). Early numeracy is comprised of skills related to 
counting and cardinality, quantity comparison, numeral knowledge, and more advanced 
mathematical (or arithmetic) operations (National Mathematics Advisory Panel, 2008; Purpura & 
Lonigan, 2013). These aspects of numeracy are critical for later mathematics skills according to 
many international benchmarks (Australia Curriculum Assessment and Reporting Authority, 
2013; Common Core State Standards, 2010; Curriculum Development Council, 2017; National 
Council of Teachers of Mathematics, 2006). Moreover, deficits in early mathematics skills are 
likely to lead to long-term difficulties (Aunola et al., 2004; Every Child a Chance Trust and 
KPMG, 2008; NRC, 2009). 

Emergent literacy skills. Three components of emergent literacy measured in preschool 
are believed to form the foundation for the acquisition of literacy skills: oral language, 
phonological awareness, and print knowledge. Oral language is comprised of skills such as word 


knowledge, vocabulary, and understanding grammatical rules and word order (Storch & 
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Whitehurst, 2002). Phonological awareness refers to children’s ability to detect and manipulate 
language through blending, matching, or removing parts of words (Wagner & Torgesen, 1987). 
Print knowledge includes children’s awareness of basic print conventions (i.e. letter names and 
sounds; Whitehurst & Lonigan, 1998). Children who enter school with difficulties in emergent 
literacy skills are likely to experience reading difficulties that persist over time (Storch & 
Whitehurst, 2002). Moreover, children with low levels of early reading skills are at elevated risk 
for needing special education services (Lentz, 1988). 

Connections between self-regulation and academic skills. A large body of research 
indicates that self-regulation is an important part of academic success in childhood, adolescence, 
and into adulthood (Blair & Raver, 2015; Duckworth, Tsukayama, & May, 2010; McClelland, 
Acock, Piccinin, Rhea, & Stallings, 2013; McClelland, Acock, Morrison, 2006; McClelland et 
al., 2007). In addition to empirical evidence indicating a strong predictive relation between self- 
regulation and academic achievement, interventions that aim to improve self-regulation have also 
shown significant effects on children’s math and literacy (Blair & Raver, 2014; Pandey et al., 
2018; Schmitt et al., 2015; Tominey & McClelland, 2011) suggesting that self-regulation may be 
an important precursor for early achievement. In addition, children’s self-regulation has been 
found to be especially predictive of early math skills where children have to focus and pay 
attention, remember and execute step-by-step instructions, and demonstrate self-control, all of 
which are important for learning math (Blair, Ursache, Greenberg, & Vernon-Feagans, 2015; 
McClelland et al., 2014; Purpura, Schmitt & Ganley, 2017). In addition, research suggests that 
relations between self-regulation and mathematics and literacy may be bidirectional and more 
complex than previously thought (Fuhs, Nesbitt, Farran & Dong, 2014; Schmitt, Geldhof, 


Purpura, Duncan, & McClelland, 2017). The bidirectional connections between self-regulation, 
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math, and literacy suggest the promise of an intervention that targets the integration of these 
skills. 

The role of socio-demographic risk for self-regulation, math, and literacy. A large body 
of research documents negative relations between children’s socioeconomic risk and children’s 
academic outcomes (e.g., Duncan & Magnuson, 2005). Children from low-income households 
typically experience more difficulty with the development of math and literacy skills than 
children from middle-income families (Jordan, Huttenlocher, & Levine, 1992). Recent work also 
documents the negative effects on children’s self-regulation (e.g., Raver, Blair, & Willoughby, 
2012; Wanless et al., 2011). In the U.S., ethnic minorities, and particularly Spanish-speaking 
English language learners (ELLs) are more likely to experience elevated risks, such as poverty 
and low parent education levels (U.S. Census Bureau, 2011), which may negatively impact 
children’s outcomes. However, research suggests that self-regulation may be an important 
protective factor for children growing up from disadvantaged backgrounds (Obradovic, 2010; 
Sektnan et al., 2010). This suggests that promoting self-regulation for children at socio- 


demographic risk is important for successful learning outcomes in school. 


Existing School Readiness Interventions 

A number of classroom-based interventions that specifically target self-regulation and 
early academic skills have demonstrated effectiveness. Examples of interventions include the 
preschool Promoting Alternative THinking Strategies (PATHS) curriculum, which focuses on 
children’s problem solving skills, emotional awareness, social-emotional skills and self-control, 
(Domitrovich, Cortes, & Greenberg, 2007; Greenberg, Kusche, 1993; Kam, Greenberg, & Walls, 
2003). There are also interventions that focus explicitly on improving preschoolers’ early math 


that have been shown to be effective such as Pre-K Mathematics (Starkey, Klein, & Wakeley, 
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2004; Thomas, Cook, Klein, Starkey, & DeFlorio, 2018) and Building Blocks (Clements & 


Sarama, 2007; Clements & Sarama, 2011). Finally, interventions designed to promote 
preschoolers’ emergent literacy have shown positive effects (Farver, Lonigan, & Eppe, 2009; 
Justice, Kaderavek, Fan, Sofka, & Hunt, 2009; Justice & Pullen, 2003). 

Although these interventions have shown to be successful at improving children’s 
outcomes, they typically require in-depth training, time (for planning/professional development 
as well as for implementation), materials, and significant expense. Furthermore, many 
interventions target a range of skills, making it difficult to determine the specific mechanisms 
that are responsible for observed changes in self-regulation and academic achievement. For 
example, Head Start REDI (Research-Based, Developmentally Informed), emphasizes literacy, 
language and social-emotional skills and has been shown to be effective at improving children’s 
self-regulation and academic outcomes (Bierman et al., 2014; Sasser, Bierman, Heinrichs, & 
Nix, 2017). Another program, Tools of the Mind, also focuses on early literacy and self- 
regulation with mixed results of its effectiveness (Blair & Raver, 2014; Farran, et al., 2013). It is 
difficult, however, to identify which aspects of these interventions are most effective and none of 
the interventions reviewed target self-regulation and early math and emergent literacy. 

Red Light, Purple Light (RLPL) Intervention 

The Red Light, Purple Light Intervention (RLPL) is a classroom-based, self-regulation 
intervention consisting of circle time, music and movement games that have been designed to 
systematically increase in cognitive complexity over 16 sessions (delivered twice a week for 
eight weeks). The games are delivered in a large-group format in 15-20 minute sessions 
(McClelland & Tominey, 2015; Schmitt et al., 2015; Tominey & McClelland, 2011). The games 


focus on the three aspects of EF (i.e., working memory, attentional or cognitive flexibility, and 
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inhibitory control) and enable children to practice self-regulation in a classroom setting (i.e., 
children play the games in a large group, such as during circle time). 

The intervention consists of five games (one played per session), which are repeated 
multiple times over the course of the intervention, but with increasing levels of complexity in the 
variation of the game that is reintroduced. An example of one of the intervention games is Red 
Light, Purple Light, which is a variation of the childhood game Red Light, Green Light. In this 
game, the teacher acts as a stoplight and holds up different colors of construction paper circles 
that represent stop and go. The first time the game is introduced, the teacher asks children to 
respond to green (“go”) and red (“stop”) circles, with children performing different actions when 
the teacher holds up green (e.g., stomp, clap, hop) and stopping or freezing when the teacher 
holds up red. The game increases in complexity where the teacher adds colors (e.g., orange and 
purple) and children are asked to respond to opposite cues. Children are also given the 
opportunity to lead, choosing colors and actions for their classmates to respond to. 

In the SR+ version of the games, literacy (print knowledge and phonological awareness) 
and math (counting and cardinality and numerical knowledge) content is embedded into the cues 
children are asked to respond to. For example, when playing Red Light, Purple Light, instead of 
responding to colors, children are shown a circle with a number written on it. In addition to 
responding to the color (e.g., clapping when they see blue, stomping when they see orange), 
children are shown a number card and asked to perform the action as many times as represented 
on the card (e.g. if teacher holds up a number 4, children clap 4 times, counting from 1-4 
together as they clap). When playing the Sleeping Game, children pretend to go to sleep when 
the teacher sings the “Sleeping Song” and then wake up and act out the animal named by the 


teacher. In the SR+ version of the game, the teacher emphasizes print knowledge and 
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phonological awareness (e.g., “When you wake up, pretend to be the first animal that I say that 
starts with an ‘m.’ Snake! Does that start with an ‘m?’ Mouse!”’). In another, teachers show a 
picture of the animal with the printed word underneath (teachers use pictures in the SR version, 
but without words). A detailed manual with information about the games and sessions is also 
given to teachers (see Methods section below). 

Like each of the RLPL games, Red Light, Purple Light targets children’s EF skills where 
children have to listen and remember instructions (i.e., working memory), successfully move 
from one rule to another (i.e., attentional flexibility), and do the opposite as part of a game (1.e., 
inhibitory control). As the intervention progresses, new games are introduced and games are 
repeated with additional rules introduced to increase cognitive complexity. In each game, 
children respond to visual and/or oral cues and are often asked to respond to opposite cues. In the 
SR+ version of the intervention, the cues children are asked to respond to before choosing their 
actions relate specifically to literacy or math. 

The self-regulation-only (SR) version of the RLPL intervention has been evaluated in two 
randomized controlled trials (RCTs) administered by researchers in preschool classrooms and 
one RCT where the games were delivered by teachers (Duncan et al., 2018; Schmitt et al., 2015; 
Tominey & McClelland, 2011). In one study, participation in the intervention was associated 
with improvement in self-regulation for children with low initial scores on self-regulation (e.g., a 
score of zero on the Head-Toes-Knees-Shoulders (HTKS) measure), and gains in literacy for the 
overall sample in comparison with a control group (Tominey & McClelland, 2011). Results from 
a larger study with children from disadvantaged backgrounds (i.e., enrolled in Head Start) found 
that participation in the intervention was significantly related to gains in self-regulation for the 


overall sample and gains in math for English language learners (Schmitt et al., 2015). In each of 
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these studies, researchers with previous classroom experience led the games in early childhood 
classroom settings. A recent study examined the RLPL games delivered by teachers and included 
as part of a summer school readiness program (Duncan et al., 2018). In the RCT part of the 
study, children who participated in the summer program with RLPL games experienced 
significant improvement in self-regulation compared to children who participated in the summer 
program without exposure to RLPL games. There were no significant effects of intervention 
participation on math or literacy at the end of the program. However, when children were 
followed into the fall of kindergarten, participation in the summer program with the RLPL 
intervention was related to greater change in self-regulation, math, and literacy scores from the 
beginning of the intervention to the fall of kindergarten compared with children’s expected 
development using a separate longitudinal sample. 

An important aspect of the RLPL intervention is the focus on ease-of-use and feasibility: 
the games require little training to implement, few materials (those readily available in early 
childhood classroom settings), and have been reported to be engaging for children with a range 
of developmental levels and needs (Tominey & McClelland, 2013). Moreover, the games were 
developed to be implemented as part of daily activities (i.e., large group time) and embedded in 
existing classroom curricula. 

Theory of Change 

Preschool is an ideal time to implement a self-regulation intervention because of the rapid 
development in the prefrontal cortex, an area associated with self-regulation and executive 
function skills (Blair, 2002). For most children, the preschool classroom is the first early learning 
environment in which they are asked to demonstrate self-regulation skills. Moreover, preschool 


is an important time for developing the early math and emergent literacy skills that are related to 
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academic achievement in later elementary and high school (Clements & Sarama, 2011; Duncan 
et al., 2007). 

Conceptually, our theory of change hypothesizes that promoting self-regulation would 
help children develop skills required to effectively take advantage of learning opportunities, 
including those that focus on math and literacy. With the added version of the intervention 
(SR+), the present study tested the idea that embedding academic content would not only help 
children develop the self-regulation skills needed to benefit from these learning opportunities, 
but also to extend that learning to those specific learning contexts. The self-regulation games 
require children to pay attention to, remember, and follow increasingly complex sets of rules 
through multiple exposure and repeated practice. 

In addition to teaching and practicing self-regulation, the SR+ components of the 
classroom games provide additional complexity and were hypothesized to impact self-regulation 
more strongly than the SR components alone. For example, given the strong relations between 
self-regulation and early academic skills, it is possible that targeting these skills together would 
have the greatest benefit on self-regulation (Duncan et al., 2007). We focused on aspects of early 
math (counting, cardinality, and numeral knowledge) and emergent literacy (phonological 
awareness and print knowledge) that are most strongly related to early self-regulation (Purpura et 
al., 2017). Previous evidence has supported the effectiveness of the intervention on self- 
regulation and academic outcomes, especially math, in young children (e.g., Schmitt et al., 2015; 
Tominey & McClelland, 2011). Thus, we anticipated that the self-regulation games would result 
in significant positive impacts on self-regulation and academic outcomes, particularly math, 
compared to the BAU delayed intervention group. 


The Present Study 
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The present study evaluated an intervention that explicitly focuses on self-regulation 
(attentional flexibility, working memory, and inhibitory control) and compared the core 
curriculum with an enhanced version of the curriculum with embedded early math (counting, 
cardinality and numeral knowledge) and literacy (phonological awareness and print knowledge) 
components, given that these skills are foundational for academic success. 

In summary, the specific aims of this study were to: 

1. Examine if there are significant effects of the self-regulation intervention (testing for 
effects of each version of the intervention: SR and SR+) on self-regulation over the 
preschool year in children from low-income backgrounds. 

2. Examine if there are significant effects of the self-regulation intervention (SR and SR+ 
versions) on children’s academic achievement (early literacy and math skills) over the 
preschool year. 

We compared two versions of the intervention (SR and SR+) with a Business-As-Usual 
(BAU) delayed intervention group on children’s school readiness skills (self-regulation and 
academic achievement) over the preschool year. One version included the self-regulation games 
from our previous research (e.g., McClelland & Tominey, 2015; Schmitt et al., 2015; Tominey & 
McClelland, 2011; SR), and one version (SR+) included enhanced early math and literacy 
components added to the original self-regulation games. Given the strong relations between early 
self-regulation and academic achievement (and math in particular), it was possible that targeting 
these skills together would have the greatest benefit on self-regulation (Duncan et al., 2007). We 
anticipated that both versions of the intervention would result in significant positive impacts on 
self-regulation and academic skills, especially math, compared to the BAU delayed intervention 


group. Further, the SR+ version was expected to lead to stronger effects than the BAU condition 
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or the SR-only intervention on early math and literacy skills because this version explicitly 

aimed to incorporate mathematical thinking and emergent literacy into the self-regulation games. 
Methods 

Participants 

Children, parents, and teachers for the current study were from a study focused on 
developing, refining, and testing the promise of a self-regulation intervention. The initial sample 
consisted of 188 children (52% female) from low-income families who were participating in 
Head Start, a U.S. preschool program for low-income families. Children were recruited from 13 
Head Start classrooms across nine sites in the Pacific Northwest of the United States. Children 
and families were recruited through consent forms distributed in enrollment packets during the 
summer prior to the start of preschool. 

In the fall of the preschool year (time 1), a total of 188 children were eligible to 
participate. At time 2 in the spring of the preschool year, 157 children from the initial sample 
participated. This was an attrition rate of 17%. Children who did not participate in the post-test 
did not significantly differ from the other children who completed the study in terms of gender, 
maternal education, English language learner (ELL) status or on any of the measures described 
below at pre-test (p > .05), but did differ in terms of age. Children who did not participate in the 
post-test session were more likely to be younger than children who did participate, #(184) = 3.10, 
p = .002. All of the analyses described below were conducted using the data from the 157 
children who contributed at least partial data at both pre-test and post-test. 

Parents’ education level ranged from 2-17 years (M = 11.27, SD = 2.30). Children were 
eligible to participate in the study if they were between the ages of 3-5 and attending, or planning 


to attend, one of the 13 target classrooms. At pre-test, children had an average age of 51 months 
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(range = 38 to 62 months, N = 41 3-year-olds, 99 4-year-olds, 17 5-year-olds), and at post-test 
had an average age of 58 months (range = 44 — 68 months, N = 12 3-year-olds, 80 4-year-olds, 
65 5-year-olds). 

More than half of the sample of children and families identified as Latino (58%), 26% 
identified as White, 7% Pacific Islander, 6% African American, and 2% reported other for 
ethnicity. Information from the consent form (child’s home language) identified 62 children 
(33%) as ELLs. Spanish-speaking research assistants administered the Pre Language Assessment 
System (preLAS) at pretest and posttest to determine whether a child should receive direct 
assessments in English or Spanish (Duncan & De Avila, 1985-1987). If children did not pass the 
preLAS, and their home language was not Spanish, they were not administered any assessments 
at that time point (n = 2). Eight teachers (all female) across 13 classrooms and seven sites 
consented to participate. Five teachers had separate morning and afternoon classrooms (n = 10 
classrooms); three teachers taught in either morning or afternoon (n = 3 classrooms). 

Procedure 

In the fall (pretest) and spring (posttest) of the preschool year, all direct assessments were 
administered using trained research assistants. Assessments were given in 10-15 minute sessions 
inside the classroom in a quiet area or in a hallway. All assessments were completed in 2-3 
classroom visits, depending on child absences, and the order of assessments was 
counterbalanced. Children identified as ELL’s were assessed by Spanish-speaking research 
assistants at pre and posttest, whether or not children passed the preLAS. Parents and teachers 
completed demographic questionnaires. 

Pretest. Direct assessments of self-regulation and early academic achievement were 


administered to children in the fall of the preschool year. 
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Intervention. To prevent contamination, block randomization occurred at the teacher 
level in the winter so that teachers leading more than one classroom (i.e., teachers with a 
morning and an afternoon class) delivered the same condition in each classroom. Eight teachers 
were included in the study who were supporting a total of 13 classrooms (half-day classrooms). 
Five teachers taught across a full day (one morning session; one afternoon session) and three 
teachers taught half-day only (one morning session or one afternoon session). Of the five full- 
day teachers, two were randomly assigned to the SR group (2 teachers; 2 classrooms each = 4 
classrooms total), two were randomly assigned to the SR+ group (2 teachers; 2 classrooms each 
= 4 classrooms total), and one was randomly assigned to the control group (1 teacher; 2 
classrooms). Of the three half-day teachers, each was randomly assigned to one of the conditions 
(SR, SR+, and control). In total, five classrooms were assigned to each intervention condition 
(SR or SR+) and three were randomly assigned to the control. Of the three sites with intervention 
classrooms, only one site had all classrooms receiving the same condition of the intervention 
(SR+). 

The training of the intervention was consistent aside from the difference in content that 
included either self-regulation content (SR) or self-regulation with embedded literacy and math 
content (SR+). Learning goals were created for each of the sessions to demonstrate how session 
content related to the specific SR or SR+ intervention condition. The SR condition did not 
include any explicit instruction related to early math or literacy skills so learning goals only 
related to the three aspects of self-regulation (inhibitory control, attentional flexibility, and 
working memory). In the SR+ condition learning goals related to those same three components 
of self-regulation, but also included an explicit focus on emergent literacy skills (e.g., embedding 


dialogue related to early literacy into game play) and early math skills (e.g., counting together 
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the number of intervention sessions | to 16; emphasizing the number of times actions were 
performed and using spoken numbers to cue children). During the intervention half-day training, 
teachers were asked not to share information across classrooms or with other teachers. 

Teacher training. Intervention classroom teachers (n = 6) attended a half-day training led 
by two master trainers, one training for SR classrooms, and one for SR+ classrooms held in 
separate locations. Teachers participating in the SR training learned about the importance of self- 
regulation in the classroom along with the core elements of the self-regulation intervention and 
had an opportunity to use their training manual and materials. Teachers participating in the SR+ 
training received a similar training to the SR classroom, but also received information on 
embedding math and literacy content into the intervention games. 

Intervention Implementation. Through an iterative development process working with a 
set of master teachers, the research team refined the RLPL training materials and classroom kits 
prior to implementation, including detailed session plans and refinement of fidelity of 
implementation surveys (i.e., surveys teachers were asked to complete following each session 
related to implementation). Teachers participating in this RCT received a comprehensive 
intervention training manual and classroom kit at training. For some classrooms, both lead and 
assistant teachers were present, however, only lead teachers (unless absent) implemented 
intervention sessions in the classroom. Following the training, 100% of teachers reported on 
training evaluation surveys that they agreed or strongly agreed they felt prepared to play the 
games in their classrooms. Implementation began one week after the training, during winter of 
the preschool year. Teachers implemented the RLPL intervention in their classrooms, twice a 


week over 8 weeks for 15-20 minutes during large group circle time. Children in the control 
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classrooms engaged in the daily routines and curricula activities that came before study 
participation (business-as-usual). 

Dosage, Fidelity, and Feasibility of Implementation. To capture dosage of the 
intervention, teachers completed an attendance sheet after each session (2x a week). Fidelity of 
implementation was monitored each week through teacher reported daily logs completed at the 
end of each session. To assess, feasibility, teachers were asked to rate their own and their 
students’ enjoyment of the games played in each session, if the manual and materials were 
helpful, and overall length, difficulty, and prep time for each session. In addition, all intervention 
classroom teachers (n = 6) received coaching support and met six times with their coach 
throughout the intervention implementation. Teachers were coached on three dimensions of 
implementation fidelity- adherence, quality, and responsiveness. As part of the coaching process, 
teachers recorded intervention sessions to be reviewed during their one-on-one coaching session 
the following week. Additionally, over the course of the intervention, 43 videos were collected 
from intervention and BAU classrooms for the research team to use and code for fidelity. The 
video coding team attended a 3-hour training on video coding processes (i.e. the importance of 
objectivity) and the coding rubric created by the coaching development team. Coders attended 
weekly meetings and provided codes on a series of master coded videos to obtain reliability. 
Once group reliability was achieved, all intervention videos were double coded and consensus 
codes were used to assess fidelity. These videos were also used to explore the presence of similar 
self-regulation games in BAU classrooms as well as to code for fidelity of implementation - 


adherence, quality, and responsiveness across all intervention classrooms. 
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Post-test. In the spring of the preschool year, the same direct assessments on self- 
regulation and academic achievement were administered to children. All research assistants were 
blind to children’s treatment and control group participation. 

Measures 

Parent demographic questionnaire. Parents completed a survey in English or Spanish 
with questions about children’s age, gender, child care experiences, health, and parent and family 
characteristics such as years of education completed, work status, and household size. 

Language Screener. The Simon Says and Art Show subtests of the preLAS were used to 
determine language of assessment. Simon Says is a measure of receptive language and Art Show 
is a measure of expressive language assessing naming and descriptive vocabulary. These two 
subtests of the preLAS have been demonstrated to have strong reliability and validity in Spanish- 
speaking preschool aged children (Rainelli et. al., 2017). If children did not pass the preLAS, and 
parent identified as Spanish-speaking, they were assessed in Spanish. 

Direct measures of self-regulation. 

The Head-Toes-Knees-Shoulders-Revised (HTKS-R) task was used to assess children's 
self-regulation and taps aspects of attention, working memory, and inhibitory control 
(McClelland et al., 2014). The task has four sections and is a complex version of the HTKS 
(McClelland et al., 2014) for children ages 3-8. In the first section, children are asked to say the 
opposite of what is instructed. In the next section, children are told to touch their head (or toes) 
when asked to touch their toes (or head). Then, in the following section, both rules are included 
(head/toes opposite and knees/shoulders opposite). In the last section, children are still doing the 
opposite, but the rules are switched with different pairings. There were a total of 58 items across 


the 4 sections. Items are scored 0 for an incorrect response, | for a self-corrected response, and 2 
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for a correct response and overall scores range from 0-116. The HTKS-R and HTKS have 
demonstrated strong reliability and validity in diverse samples around the world including 
significant relations to other tasks measuring aspects of self-regulation and executive function 
(e.g., McClelland et al., 2014; Wanless et al., 2011). The measure has also been sensitive to 
intervention effects, showing significant change in response to participation in self-regulation 
interventions when compared with children in a control group (Duncan et al., 2018; Landis, Hart, 
& Graziano, 2018; Schmitt et al., 2015; Tominey & McClelland, 2011; Upshur et al., 2019). In 
the current sample, the HTKS-R demonstrated adequate to strong internal reliability (Cronbach’s 
alpha = .96 at pretest and .97 at post-test). 

Children’s inhibitory control was assessed using the Day-Night Stroop task (Gerstadt, 
Hong, & Diamond, 1994). Children are presented with 16 cards with pictures of a sun or moon 
and asked to say the opposite (e.g., “day” for a moon and “night” for a sun). The measure has 
demonstrated strong reliability in research (McClelland et al., 2014; Rhoades, Greenberg, & 
Domitrovich, 2009). In the current sample, the Day-Night Stroop task demonstrated strong 
internal reliability (Cronbach’s alpha = .90 at pre-test and .91 at post-test). 
Academic outcomes 

Emergent literacy skills. The Letter-Word Identification subtest of the Woodcock 
Johnson Tests of Achievement (Woodcock, McGrew, & Mather, 2001) or The Bateria III 
Woodcock- Mufioz (Mufioz-Sandoval, Woodcock, McGrew, & Mather, 2005) was used to assess 
emergent literacy. Research has shown high reliability and validity (a > .80) for all of the 
subtests (Schrank et al., 2005; Woodcock & Mather, 2000). In the present study, W scores were 
used in the analyses, which are standardized based on the average performance for a child at a 


particular age (Jaffe, 2009). W scores are appropriate for emergent literacy skills. The Letter- 
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Word Identification subtest measures children’s letter skills and developing word-decoding skills 
with strong reliability and validity. Reliability for English-speaking preschool children ranges 
between .98-.99 and .84-.98 for Spanish-speaking children. 

Early math skills. Children’s early math skills were assessed using the Preschool Early 
Numeracy Skills Screener (PENS; Purpura, Reid, Eiland, & Baroody, 2015). This numeracy task 
consists of 24 items that are ordered by difficulty, progressing from the easiest items to the most 
difficult. The PENS assesses aspects of numeracy including set comparisons, numeral 
comparisons, one-to-one correspondences, number order, numeral identification, ordinality, and 
number combinations. Children receive | point for each correct answer. If a child responds 
incorrectly to three items in a row, the assessment ends. The assessment takes approximately 5 
minutes to administer. In the current sample, the PENS demonstrated adequate internal reliability 
(Cronbach’s alpha = .91 at pre-test and .92 at post-test). 

Control variables. Children’s age in months, gender, parent education in years, ELL 
status, and baseline self-regulation or academic achievement scores were used as control 
variables in models. Previous research has shown these variables to be related to children’s self- 
regulation and early academic achievement (Cameron Ponitz et al., 2009; Wanless et al., 2011). 

Results 
Analytic Strategy 

All analyses were conducted using Stata 15.1 (StataCorp, 2017). Due to the hierarchical 
structure of the data with children nested within different classrooms, we first evaluated whether 
a multilevel framework was necessary to accurately test the effects of the two versions of the 
intervention in comparison with a BAU control. The ICCs from the intercept-only models for 


both the self-regulation outcomes (ICC range: .02 -.05) and the academic outcomes (ICC range: 
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<.001 - .001) were small, but were within a range where accounting for the nested structure of 
the data is appropriate (Hox, Moerbeek, & van de Schoot, 2010). Thus, we utilized clustered 
robust standard errors for all analyses described below which adjust standard errors for the 
nested structure of the data. 

We ran separate, but parallel analyses for each of the self-regulation and academic 
outcomes. All models included children’s performance at pre-test on the outcome variable, their 
age, gender, ELL status, and parent level of education when evaluating the effect of the different 
interventions. For each model, we also utilized an intent to treat (ITT) analysis (Fisher et al., 
1990) where children’s scores were analyzed as part of their assigned intervention group 
regardless of whether or not they were present for all aspects of their assigned intervention 
group. To calculate the estimated effect sizes of the interventions on the outcome variables, the 
estimated mean differences over and above the control group from each of the final models were 
divided by overall standard deviation of the outcome variable at pre-test (Feingold, 2009). 

Missing Data. For the 157 children in the analyses, data were missing for a small 
percentage of children on the HTKS-R at pretest (8%) and post-test (10%), Day-night at pretest 
(3%) and posttest (6%) WJ-Letter-word at pretest (3%) and posttest (8%) and on PENS at pretest 
(3%) and posttest (11%). Data on individual measures were typically missing due to child 
absences at one of the testing sessions or other extraneous factors. For all of the analyses 
described below, these data were assumed to be missing at random (MAR; Little & Rubin, 
2002). Although there are no definitive tests of the MAR assumption (Baraldi & Enders, 2010), 
we assessed whether missingness on any of the variables was due to any auxiliary variables 
available in the dataset using logistic regression and no significant predictors emerged. Thus, we 


concluded an MAR assumption was valid (Acock, 2012). 
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To account for MAR data in our analyses, we ran path models with a full information 
maximum likelihood (FIML) estimator in Stata 15.1 (Muthén & Muthén, 2012; StataCorp, 2017) 
for all of the final models described below. A FIML estimator utilizes all available data in the 
analysis and provides more unbiased estimates compared to traditional missing data techniques 
such as pairwise or listwise deletion (Enders & Bandalos, 2001). 

Fidelity of Implementation 

On average, participating children attended 14 sessions across both intervention groups 
and 95% of participating children attended at least 10 intervention sessions. As noted above, 43 
videos were collected from intervention and BAU classrooms and coded for fidelity (adherence, 
quality, and responsiveness). All participating teachers delivered 100% of the intervention 
sessions, in order, and on the dates scheduled (two times per week for eight weeks). Videos of 
intervention classrooms indicated that teachers implemented the intervention effectively (e.g., 
played the correct games, modeled appropriate behaviors) and adhered to the condition of the 
intervention they were trained in. Coders did not observe any deviations from the session guides 
and learning objectives included in the training manual. All participating classrooms (BAU and 
intervention classrooms) used Creative Curriculum. A review of the curricula and lesson plans 
used by BAU classrooms along with video observations also confirmed that teachers in BAU 
classrooms were not playing self-regulation games of a similar nature to those in either version 
of the intervention as part of their typical practice. 

Descriptive Statistics 

Bivariate correlations between all these variables are also presented in Table 1. 

Descriptive statistics for all direct assessments at pretest and posttest and all control variables are 


presented in Table 2. Two-sample t-tests (Table 1) were conducted to assess for any differences 
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at pre-test between children assigned to the BAU control group and children assigned to either of 
the intervention conditions. Although random assignment was utilized, significant baseline 
differences were found on children’s performance on the HTKS-R and on the PENS at pretest 
and marginally significant differences were found on children’s performance on Day-Night at 
pretest. There were also significant differences in the proportion of ELL children in the BAU 
control group and the two intervention groups. Specifically, children in classrooms with teachers 
randomly assigned to the control group had higher baseline scores on each of these measures 
than children in classrooms with teachers randomly assigned to treatment groups. Thus, fall 
baseline scores on the HTKS-R, Day-Night, or PENS were included as control variables in 
models predicting these corresponding outcomes in the spring. In addition, ELL status was 
included as a control variable in all models. 

Hypothesis Testing 

Parallel path models utilizing all available data at post-test were conducted for each of the 
outcome variables which are presented below. Estimated effects of treatment condition and all 
other covariates in the final models are included in Table 3. 

Self-Regulation Outcomes. We first tested whether there were any effects of either 
condition of the intervention (SR and SR+ versions combined) on children’s self-regulation over 
the preschool year, given that both conditions included the same underlying self-regulation 
components. As shown at the top of Table 3, children receiving either version of the intervention 
demonstrated higher self-regulation on the HTKS-R at post-test compared to the business as 
usual group. Although results were not statistically significant, they indicated a significant trend 
(B = .09, p = .082). In addition, the estimated mean difference of children’s self-regulation at 


post-test over and above the BAU group (M = 6.81 points, Cohen’s d= .31, 95% CI: -.10 - .72) 
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were similar to gains made on the HTKS in previous intervention studies (Schmitt et al., 2015; 
Duncan et al., 2018) and consisted of a 21% difference over and above the BAU group at post- 
test. 

When evaluating the individual intervention types as shown at the bottom of Table 3, 
gains in self-regulation for the SR+ group over the BAU group were larger (M = 6.93 points, 
Cohen’s d= .32, 95% CI: -.26 - .76) with a trend for a significant difference over and above the 
BAU group (f = .11, p = .066), whereas estimated gains on the HTKS-R in the SR group were 
smaller (M =5.41 points, Cohen’s d = .25, 95% CI: -.11 - .75), and were not significantly 
different from the BAU group ( = .09, p = .168). Although there was a trend for the effect of 
the SR+ version to be larger than the SR version, the difference between the two intervention 
groups was not statistically significant (p =.394, d = .07, 95% CI: -.44 - .58). Children’s 
estimated mean performance on the HTKS-R at post-test is illustrated in Figure 1A. Differences 
in children’s performance on the Day-Night task at post-test were not significantly different 
between children in either of the intervention groups and the BAU control group. 

Academic Achievement Outcomes. Second, we tested whether there were any significant 
effects of either version of the intervention (SR and SR+) on children’s academic achievement 
(early literacy and math skills) over the preschool year. As shown on Table 3, children receiving 
either intervention demonstrated significantly higher math scores on the PENS at post-test 
compared to children in the BAU group (f = .14; p = .003). The estimated mean difference in 
children’s math ability on the PENS (M = 1.75 points, Cohen’s d= .38, 95% CI:.15 - .61) was 
equivalent to a 24% difference over and above the BAU group. 

Children in the SR+ version of the intervention demonstrated significantly higher math 


scores on the PENS at post-test (8 = .17, p = .003) compared to children in the BAU group (M = 
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1.76 points, Cohen’s d = .38, 95% CI: .15 - .61) with a similar significant difference (6 = .14, p 
= .016) for children in the SR version of the intervention (M = 1.57; Cohen’s d = .34, 95% CI: 
.07 - .62). Estimated mean differences in children’s math ability on the PENS did not differ 
significantly from the SR intervention group or SR+ intervention group versions of the 
intervention, p =.698, Cohen’s d = .03, 95% CI: -.26 - .40. Children’s estimated mean 
performance on the PENS at post-test is illustrated in Figure 1B. 

Finally, we tested whether either version of the intervention demonstrated any significant 
effects on children’s early literacy skills. As shown on the top of Table 3, children receiving 
either version of the intervention did not demonstrate any significant difference in their early 
literacy skills compared to the BAU group at post-test (6 = .01, p = .924). As shown in Figure 
3C, when examining the intervention groups individually, neither the SR intervention, (6 = .06, p 
= .108) nor the SR+ intervention (f = -.02, p = .609) demonstrated any significant difference 
compared to the BAU group. 

Exploratory Analyses. We also conducted a series of exploratory analyses to assess 
whether there were any significant effects of the interventions (SR and SR+ versions) on 
children’s self-regulation (measured on the HTKS) over the preschool year for children who 
started out with initially low levels of self-regulation on the HTKS as in previous studies (e.g., 
Tominey & McClelland, 2011). First, we tested for an interaction between the effect of the 
intervention and whether children started with low initial levels of self-regulation, and then 
conducted a subgroup analysis examining the effect of the intervention for children with low 
self-regulation. However, given the available sample size in the current study, results reported 


below should be interpreted with caution. 
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In a previous study (e.g., Tominey & McClelland, 2011), children were determined to 
have low levels of self-regulation if they initially received a zero on the HTKS. The HTKS-R 
contains all the same components of the HTKS but adds a downward extension to capture more 
variability in children with low self-regulation.. To capture the limited variability of children 
with low-levels of self-regulation on the HTKS-R and align with previous studies, we coded 
children as having low self-regulation if they did not get at least 4 out of the 6 possible points on 
the initial practice questions for Part 1 of the measure. At pre-test, 74% of children (n = 116) did 
not meet the initial threshold on the HTKS-R. 

We tested an interaction between the effect of intervention type (BAU, SR, or SR+) and 
children with low levels of self-regulation at pretest. Results indicated a significant interaction 
between the intervention groups and children’s low self-regulation status. Children with low self- 
regulation children in the SR group showed an additional benefit of the intervention compared to 
children with high self-regulation, # = .35, p = .037. In contrast to the analyses with the overall 
sample (Figure 1A), for children with low initial HTKS-R scores at pre-test, children in the SR 
and SR+ intervention groups showed significant gains in self-regulation over and above the BAU 
group at post-test. This subgroup analysis for the interaction is shown in Figure 2. 

Discussion 

The goal of this study was to examine a self-regulation intervention that explicitly 
focused on self-regulation (attentional flexibility, working memory, and inhibitory control) and 
to compare the self-regulation-only version of the intervention (self-regulation; SR) with an 
enhanced version that included emphasis on best practices to support early math (counting and 
cardinality and numeral knowledge), and literacy (phonological awareness and print knowledge; 


SR+). We examined if there were significant effects of the self-regulation intervention (SR and 
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SR+ versions) on children’s self-regulation and academic outcomes (early literacy and math 
skills) over the preschool year. 

Results indicated that although not statistically significant, there was a trend for children 
receiving either version of the intervention to show greater improvement on a measure of self- 
regulation, and results for the SR+ version also demonstrated a trend towards significant 
improvements in self-regulation. Children receiving either version of the intervention gained 
significantly more in math over the preschool year compared to children in the BAU group, but 
there were no differences between groups on literacy performance. 

Effects of the Intervention on Self-Regulation Outcomes 

The present study demonstrated that children receiving either intervention version 
demonstrated higher self-regulation on the HTKS-R at post-test compared to the BAU group, 
based on measures of effect size, but results were not statistically significant. Gains on the 
HTKS-R for either version and for the SR+ version over the BAU group were larger and 
approached significance (d = .31 and d = .32 respectively), whereas gains on the HTKS in the 
SR version were smaller (d = .25). Despite the small sample size, effects from either version of 
the intervention (d= .31) were similar to effect sizes in previous studies, which were (d = .32) in 
Schmitt et al. (2015) and (d= .33) in Duncan et al. (2018). The lack of significant effects may be 
in part due to limited power and the small sample size in the present study, but the consistency in 
effect sizes across studies suggests the promise of a robust intervention effect (Cumming, 2014). 
This research also aligns with other similar interventions documenting improvements in 
children’s self-regulation (Blair & Raver, 2014) and recent meta-analyses of self-regulation 
interventions (Pandey et al., 2018), which supports the substantive and practical significance for 


effects of this size (Hill, Bloom, Black, & Lipsey, 2008). 
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Effects of the Intervention on Early Academic Outcomes 

Effects on Math. Children receiving either version of the self-regulation intervention had 
significantly higher math scores at post-test compared to children in the BAU group, which was 
equivalent to a 24% difference in math at the end of the preschool year. Children in the SR+ 
version of the intervention had significantly higher math scores at post-test compared to children 
in the BAU group and children in the SR version showed a similar pattern. Effect sizes for either 
version of the intervention (.38) and for the two versions of the intervention were substantive 
(.38 and .34, respectively). The size of the effects did not significantly differ by intervention 
version (SR+ and SR), which suggests that there is something about the cognitive complexity in 
the self-regulation games that promotes early math skills especially in children from low-income 
backgrounds (as defined by Head Start enrollment in the U.S.) rather than the addition of the 
math and literacy components. These results support other research on self-regulation 
interventions (e.g., Blair & Raver, 2014; Schmitt et al., 2015), which have found significant 
effects on children’s early math skills. This is also supported by research finding bidirectional 
relations between early math and self-regulation skills in early childhood (Cameron, Kim, 
Duncan, Becker, & McClelland, 2019; McClelland & Cameron, 2019; Schmitt et al., 2017). The 
nature of the intervention games required children to pay attention to, remember, and follow 
increasingly complex sets of rules, which are especially important for children’s early math 
development (McClelland et al., 2014; Purpura et al., 2017). Overall, results from the present 
study suggest that self-regulation interventions can improve early math skills in children from 
low-income families. 

Effects on Literacy. Differences in children’s early literacy at post-test were not 


statistically different between the intervention groups and the BAU group. Previous research has 
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shown mixed effects; one study on the RLPL intervention showed an overall intervention effect 
on improved early literacy skills with a diverse sample of children from a range of 
socioeconomic backgrounds (Tominey & McClelland, 2011), but a study with a low-income 
sample did not find significant effects of the intervention on children’s literacy skills (Schmitt et 
al., 2015). It is possible that effects are present in more diverse samples of children. Another 
possibility is that relations between early literacy and self-regulation are weaker than relations 
between math and self-regulation and math in early childhood (Blair et al., 2015). In older 
children, however, stronger reciprocal relations have been found between complex aspects of 
literacy such as comprehension and self-regulation (Connor et al., 2016). The results of the 
present study do not clearly indicate if self-regulation interventions can improve children’s early 
literacy skills and more research is needed. 
Differential Intervention Effects 

Previous research has pointed to the importance of examining differential intervention 
effects on children with low initial self-regulation and children from low-income families 
(McClelland, Tominey, Schmitt, & Duncan, 2017). Results from the current study indicated that 
children in the intervention with low baseline levels of self-regulation measured at the fall of 
preschool (pre-test) made significantly greater gains in self-regulation compared to children in 
the BAU control group with higher self-regulation measured at pre-test. This supports other 
research demonstrating that children with low initial self-regulation may show stronger self- 
regulation gains in the RLPL intervention and other self-regulation interventions compared to 
children with higher baseline levels of self-regulation (Sasser et al., 2017; Tominey & 
McClelland, 2011). It may be that children with low initial levels of self-regulation demonstrate 


greater risk (e.g., have exposure to greater stress and are at risk from coming from chaotic 
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backgrounds (Blair & Raver, 2012) and have more room to improve when participating in 
interventions. This idea has been called the compensatory hypothesis and suggests that targeting 
children with low self-regulation may be one way to support school readiness in young children 
from low-income families. One hypothesized explanation could be that children who showed 
significant gains with low scores at the beginning of the year were simply demonstrating 
regression to the mean. Given the use of classroom randomization, however, regression to the 
mean is unlikely because children in the BAU control classrooms did not show the same level of 
improvement over the year (Diamond & Ling, 2016). Overall, however, more research is needed 
to investigate and replicate these findings, especially in larger and more diverse samples of 
children. 
Limitations and Future Directions 

Results from the present study provide additional information about the effectiveness of a 
self-regulation intervention on school readiness in children from low-income families, but there 
were limitations. First, although the study specifically focused on the iterative development of 
the intervention and included an RCT to evaluate the promise of the intervention, the study 
sample was small and had limited power given that results were clustered at the (teacher) level. 
Future research needs to examine effects with a larger sample. Second, the sample focused on 
children from families with low incomes based on research indicating that these children may 
especially benefit from the RLPL intervention (e.g., Schmitt et al., 2015). However, this limited 
our ability to generalize findings beyond children from low-income families in the U.S. and 
future research needs to include more diverse samples of children. Third, although random 
assignment was used to assign teachers (and thus classroom children) to intervention and control 


groups, there were baseline differences on several of the variables of interest. All models 
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included baseline skills, but our ability to make causal inferences was limited. Although results 
of the present study supported previous RCT evaluations of the RLPL intervention (Duncan et 
al., 2018; Schmitt et al., 2015; Tominey & McClelland, 2011) more research is needed. Fourth, 
although we used two measures of self-regulation, we largely treated self-regulation as a 
unidimensional construct. Future studies need to include additional measures that explicitly tap 
into other aspects of EF (e.g., cognitive flexibility) to better understand generalizability of our 
findings to other domains of self-regulation. Expanding the number of self-regulation measures 
would also enable the use of latent variable approaches allowing for a more nuanced 
understanding of the self-regulation construct. In addition, although the literacy aspect of the 
intervention was focused on print knowledge and phonological awareness, the outcome measure 
was a more general literacy measure that broadly captured letter knowledge and decoding. Thus, 
there may have been more targeted intervention effects on specific aspects of literacy that were 
not captured by the outcome measure. Future work should consider the use of measures of each 
of the individual targeted components of literacy to best evaluate potential intervention effects. 
Finally, the study focused on two versions of a self-regulation intervention (SR and SR+), 
which did not vary significantly in their impact on child outcomes. The primary difference was 
an enhanced emphasis on best practices to promote early math and emergent literacy skills in the 
SR+ version of the intervention. As Head Start centers, the early childhood programs where the 
RCT was conducted had significant support and emphasis on embedding best practices to 
support emergent literacy and early math into their daily routines. Given the existing emphasis 
on these skills, the difference in intervention conditions may not have been as great as it would 


have been in settings where there was less support to integrate these skills into daily practice. 
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Despite these limitations, there are a number of practical implications based on the 
present study. First, results of the present study largely replicated previous research on the RLPL 
intervention including three RCTs (Duncan et al., 2018; Schmitt et al., 2015; Tominey & 
McClelland, 2011). Together, results from these studies suggest that the games included in the 
RLPL intervention are cognitively complex and can improve children’s self-regulation and early 
academic outcomes. Although results were largely consistent between the SR and SR+ versions 
of the intervention in the present study, there was some indication that adding math and literacy 
components to the intervention resulted in stronger outcomes than the SR version. This 
possibility needs to be more rigorously tested in a larger scale study with a more diverse sample 
of children. These findings also point to the importance of promoting self-regulation, math, and 
literacy as a way to support children’s school readiness, especially in children from low-income 
families. 

Second, results suggest that the RLPL intervention, as an example of a short-term, low- 
cost, and feasible intervention, can produce substantive improvements in children’s math skills, 
with some indication of improvements in self-regulation. The RLPL intervention required 
minimal training (one three-hour workshop) and materials were low-cost and readily available in 
most early childhood classrooms (e.g., construction paper). Moreover, the games could be 
embedded in teachers’ everyday curricular practice (e.g., circle times), which increased the 
feasibility of the intervention. These factors point to the scalability and feasibility of the 
intervention although more work is needed to further assess these potential benefits. Overall, the 
present study provides additional evidence that the RLPL intervention and similar interventions 
focused on self-regulation may be an effective and feasible way to improve low-income 


children’s school readiness skills. 
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Conclusions 

Results extend previous research and suggest that the RLPL intervention, which includes 
music and movement games, can improve children’s math scores over the preschool year. There 
was also evidence that the intervention resulted in gains in children’s self-regulation, especially 
for children with low self-regulation scores at baseline. These findings suggest that low-cost 
interventions, which are engaging and developmentally appropriate for young children, can 
improve school readiness with the potential to be scalable and practical for early childhood 
teachers. Interventions that focus on supporting self-regulation and school readiness can help 
ensure that children from low-income backgrounds enter school with the skills they need to be 


successful. 
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Table 1 
Pairwise Correlations of variables 
Variables 1 2 3 4 5 6 7 8 9 10 11 12 13 
1. Age - 
2. Gender 18" - 
3. Fall ELL Status -.11 -.04 - 
4. Parent Edu -.13 12 -.37" - 
5. Fall HTKS 33°" 00 -37"" 15 - 
6. Spring HTKS 46°" 04 -.33°" 23 56°" - 
7. Fall Day-Night .08 -.10 10 -.15 17" 10 - 
8. Spring Day-Night 09 -.07 -.03 -.05 one oo 30°" ; 
9. Fall Letter-word 40°" -.04 12 -.11 a fi 330 19° 12 - 
10. Spring Letter-word = .30°™* -.03 -.07 -.07 38°" 36°" 21" 15 64°" - 
11. Fall PENS 54" .03 -.33°" .20 62°" .62*"* 16" .18* 48°" 56°" - 
12. Spring PENS ey 10 -41°" 04 52°" 68°" 15 .29""" 48°" 56°" 12s? - 
13. SR Treatment 12 02 AT -.36"" -.06 -.04 .06 -.03 12 14 -.09 00 - 
14. SR+ Treatment -.11 -.11 .06 12 -.09 -.01 .06 08 -.19* -.19" -.07 -.01 -.62"" 


Note: *=p < .05, ** =p <.01, *** =p <.001 


36 
Red Light, Purple Light! 


Table 2 


Means (SD) of each variable by intervention condition 


Overall Sample (N = 157) Difference Tests > 


Any Treatment 


BAU (N = 37) SR (N = 59) SR+ (N = 61) (N = 120) t g 

Age 51.73 (6.90) 52.84 (5.49) 51.04 (6.45) 51.92 (6.04) t (155) = 0.17 .03 
Gender 9 1 43 AT 7 (1) =2.66 

Fall ELL-Status .05 .36 30 8 7 (1) = 10.76" 

Parent Education 12.26 (1.43) 10.13. (3.23) 11.62 (1.31) 10.83 (2.61) 1(68) = 2.26" .60 
Fall HTKS 29.84 (23.80) 21.36 (23.92) 20.30 (17.13) 20.83 (20.72) t (142) = 2.10" A2 
Spring HTKS 41.52 (27.61) 36.74 (31.22) 38.05 (32.54) 37.43 (31.79) t (145) = 0.67 13 
Fall Day-Night 15.63 (11.44) 18.72 (9.31) 18.73 (9.68) 18.73 (9.46) t (151) = 1.627 31 
Spring Day-Night 21.6 (10.34) 22.09 (9.45) 23.38 (8.85) 22.79- (9.13) t (146) = 0.63 AZ 
Fall Letter-Word 314.94 (28.9) 315.5 (25.98) 305.65 (21.11) 310.49 (24.04) t (151) = 0.92 18 
Spring Letter-Word 331.09 (25.83) 333.29 (22.72) 323.33 (22.13) 328.08 (22.86) t (142) = 0.65 13 
Fall PENS 6.71 (5.26) 4.59 (4.32) 4.69 (4.31) 4.64 (4.29) Est y= 235° 46 
Spring PENS 8.94 (5.69) 8.75 (5.87) 8.69 (5.20) 8.72 (5.51) t (139) = 0.20 .04 


> Difference tests (Hedge’s g) calculated between the BAU group and both treatment groups combined (Any Treatment). 
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Table 3 
Estimated effects for intervention conditions vs. BAU control on self-regulation, mathematics, and literacy at post-test (N = 157) 


BAU versus Any Treatment 


Variable Self-Regulation Math Literacy 
Bp SE P-value Cohen's d Bp SE P-value _ Cohen’s d Bp SE P-value — Cohen’sd 
Pre-test Score 40 06 <.001 9 .O7 < .001 .64 07 <.001 
Age 35 05 <.001 5 .O5 004 .06 .10 534 
ELL- Status -.09 08 .246 -.22 04  <.001 -.13 .09 172 
Gender -.03  .06 .680 03 07 .676 02 07 791 
seem 2 06 <.001 05 .05 374 Ol 13° 924 
Intervention® .09 = .07 082 31 14.05 .003 38 O01 05 401 03 
BAU versus SR and SR+ 
Variable Self-Regulation Math Literacy 
Bp SE p-value  Cohen’sd Bp SE p-value Cohen’s d Bp SE p-value Cohen's d 
Pre-test Score 39 07 <.001 .60 .06 < .001 .62 07 <.001 
Age 34 05 <.001 5 05 002 .06 .10 524 
ELL-Status -.10 .O7 158 -.22 04 < .001 -.13 .09 71 
Gender -.02 .06 695 03 .O7 657 -.03 .O7 dad 
ae 18 08 ~—-.023 -0T 05 215 03 13 816 
Intervention 
SR? .09 09 .168 25 14 .06 016 34 .06 .O5 .108 12 
SR+ 11 .O7 .066 we 17 .06 004 38 -.02 .08 .609 .03 


Note: All estimates are from a path model accounting for missing data (estimator = FIML) and the nested data structure (robust clustered standard errors). 
“P-values for Intervention effects are |-tailed tests. 
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Figure 1. Estimated means at post-test in (A) Self-Regulation, (B) Math, (C) Literacy (+/- S.E.) 
the BAU, SR and SR+ groups controlling for initial scores at pre-test, age, ELL-status, gender 


and parental education. 
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Estimated Mean for Spring Self-Regulation 


BAU SR SR+ 


Figure 2. Estimated means at post-test (+/- S.E.) for self-regulation in children with low initial 


levels of self-regulation. 
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